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(g) Method and apparatus for controlling presentations of objects on a user interface of a data 
processing system. 

(57) Objects on a data processing system are 
provided to a multimedia presentation device 
for presentation purposes. Each object is pro- 
vided with one or more attributes. These attri- 
butes are registered before the presentation. 
When an object is selected for presentation, the 
object is transformed into a presentable format 
in accordance with its attributes. Such attri- 
butes include whether the object is restricted 
for display, the particular presentation device or 
devices that will present the object the types of 
transforms to be performed on the object to 
ready the object for presentation, whether the 
object should be segmented into plural seg- 
ments and if so, then the manner in which the 
segments are presented. After the transfor- 
mation, the object is provided to the approp- 
riate presentation device. 
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The present invention relates to methods and ap- 
paratuses for providing multimedia presentations us- 
ing user interfaces of data processing systems. 

Multimedia presentations are becoming more 
prevalent in office meetings. Meeting rooms equip- 
ped with multimedia devices can typically contain an 
overhead projector, an electronic transparency de- 
vice located on the overhead projector, a computer 
connected to the electronic transparency device, mi- 
crophones, etc. 

The computer provides a desktop, or a user inter- 
face, for a person presenting information in the meet- 
ing room. The information which is to be presented to 
the audience is represented on the desktop as one or 
more objects. The desktop may contain additional in- 
formation in the form of objects that are not meant to 
be presented to the audience in a meeting room. For 
example, the additional information may be of a con- 
fidential nature. Also, the additional information may 
not be pertinent to the presentation. With prior art 
techniques, such additional information may be inad- 
vertently displayed, interrupting the presentation. 

It is an object of the present invention to provide 
a method and apparatus for controlling the desktop 
objects that will be provided to a presentation device. 

The method and apparatus of the present inven- 
tion present an object in a data processing system. 
The presentation is with a presentation device. The 
object is provided with attributes that are relevant to 
the presentation of the object. Then, it is determined 
when the object is to be presented. The object is 
transformed into a displayable format in accordance 
with the attributes and the transformed object is pro- 
vided to the presentation device. 

In one aspect of the present invention, the deter- 
mination of when the object is to be presented is made 
by displaying a representation of the object and a rep- 
resentation of the presentation device on a user inter- 
face of the data processing system and then deter- 
mining if the object representation is associated with 
the presentation device representation. 

The present invention provides a mechanism that 
is cognizant of an object, and its attributes, which ob- 
ject is provided to a presentation device. A registra- 
tion service allows a user to define the attributes of 
an object Such attributes include whether the object 
is restricted for display, the particular presentation 
device or devices that will present or display the ob- 
ject, the types of transforms to be performed on the 
object to ready the object for presentation by the pre- 
sentation device, whether the object should be seg- 
mented into plural segments and if so then the man- 
ner in which the segments are presented (that is the 
segments are either automatically or manually 
changed). 

Once the object is registered, it can then be pre- 
sented. Presentation of the object includes process- 
ing the object so that when the object is passed to the 



presentation device, the object will be presented in 
accordance with its attributes. In this manner, the ob- 
ject can be presented by a wide variety of presenta- 
tion devices, independently of the unique character- 

5 istics of those presentation devices. The object is 
transformed into a displayable format in accordance 
with its attributes. The transformed object is then pro- 
vided to the presentation device for presentation. 
Fig. 1 is a schematic diagram of a preferred em- 

10 bodi ment of a presentation system on wh ich the pres- 
ent invention can be practiced. 

Fig. 2 is a schematic representation of a desktop. 
Figs. 3-4c are flow charts showing the method of 
the present invention, in accordance with a preferred 

15 embodiment Fig. 3 shows the registration method or 
service for objects which are to be presented on a 
presentation device. Figs. 4a-4c show the presenta- 
tion method. 

In Fig. 1, there is shown a schematic diagram of 

20 a data processing system 1 1 , upon which the present 
invention can be practiced. The data processing sys- 
tem is an individual computer 11 workstation. The 
computer 11 may operate in a stand alone environ- 
ment or be linked to other computers by a network or 

25 other communications link. The computer includes a 
user interface, which has a display screen 13 and a 
keyboard 15. The computer contains a storage device 
such as one or more disk drives for either hard or flop- 
py disks. 

30 The computer is connected to one or more multi- 

media presentation devices 17. In Fig. 1, a conven- 
tional overhead projector 18 is shown as the presen- 
tation device. The overhead projector 18 typically 
contains a light source that shines through a transpar- 

35 enttop window. Afocusing device 19 focuses the light 
onto a projection screen 21 for viewing by an audi- 
ence. 

The top window of the overhead projector 1 8 re- 
ceives either transparencies or an electronic trans- 

40 parency device 23, either one of which provide im- 
ages for projection onto the projection screen 21 . In 
the present invention, transparencies are not used. 
Instead, an electronic transparency device 23 pro- 
duces the images electronically. The images are pro- 

45 duced on a transparency screen 24. The light from 
the overhead projector passes through the transpar- 
ency screen 24, wherein the electronically generated 
images are projected onto the projection screen 21. 
The electronic transparency device 23 allows the pro- 

so jected images to be changed. Such electronic trans- 
parency devices 23 are conventional and commer- 
cially available. An example of one such device is sold 
under the trademark Barco. 

The computer 11 is connected to the electronic 

55 transparency device 23 through a video adapter card 
located inside of the computer. The computer pro- 
vides the electronic images to the electronic trans- 
parency device for projection. The electronic trans- 
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parency device 23 and the overhead projector 18 
make up the presentation device 17. 

Other types of multimedia presentation devices 
could be utilized. For example, the presentation de- 
vice could be a television screen, multiple television 
screens or a projection television screen. Such pre- 
sentation devices display video frames. The presen- 
tation device need not be visually oriented, but could 
be audio devices such as speakers. 

All of the equipment in Fig. 1 may be contained 
in a meeting room or other appropriate venue. The 
user, or person making a presentation to the audi- 
ence, operates the computer 11. On the computer 
screen 13, a desktop 25 is displayed as shown in Fig. 
2. The desktop 25 is a window or panel with plural ob- 
jects located thereon. The objects are represented as 
icons. The overhead projector 17 is represented by a 
projector icon 17A. There is provided an icon 27Afor 
information referred to as Chart A, and an icon 29 for 
information which is referred to as Doc (document) A. 
Chart A and Doc A represent objects that are to be dis- 
played to the audience during the presentation. Other 
icons located on the desktop are: a file cabinet 31 that 
contains plural files, charts or documents, a mailbox 
33, a letter 35, a phone 37 and a printer 39. These lat- 
ter objects or icons represent information which is not 
to be displayed to the audience. 

The presentation is composed before the actual 
presentation is made. In addition to creating the ob- 
jects that are to be presented, composition includes 
providing attributes for the objects. The method of 
Fig. 3 provides a registration service for each object 
that is to be presented. 

In order to project chart A onto the projection 
screen 21 , the operator manipulates the Chart A icon 
27Aon the desktop 25. Using a mouse cursor 41, or 
other in put device, the operator drags the Chart A icon 
27Aand drops it onto the projector icon 17A. The op- 
erator could also inadvertently drag and drop the 
phone icon 37 onto the projector icon. This action of 
dropping an icon onto the projector icon invokes the 
method of Figs. 4a-4c. 

In general, the method of Figs. 4a-4c processes 
the object so that when the object is passed to the pre- 
sentation device 1 7, the object will be presented in ac- 
cordance with its attributes. In this manner, the object 
can be presented by a wide variety of presentation de- 
vices, independently of the unique characteristics of 
those presentation devices. First, the method deter- 
mines if the object should be displayed to the audi- 
ence. If not, as in the case of inadvertently dropping 
the phone icon 37 onto the projector icon 1 7 A, then 
display is prevented and the user is notified. If the ob- 
ject is unrestricted for display, then the method deter- 
mines what presentation device will display the ob- 
ject, and if the object is of a displayable type. The ob- 
ject is then transformed into a displayable type. If the 
object is to be displayed in a segmented format, then 



the method formats the object into displayable seg- 
ments and the segments are displayed temporally 
with either automatic or manual control. 

Referring now to Figs. 3-4c, the specifics of the 

5 flow charts will be discussed. In the flow charts, the 
following graphical conventions are observed: a rec- 
tangle for either a process or function, a display sym- 
bol for a screen display, a diamond for a decision and 
a pentagon and a circle for off page connectors. 

10 These conventions are well understood by program- 
mers skilled in the art of user interfaces and the flow 
charts are sufficient to enable a programmer skilled 
in the art to write code in any suitable computer pro- 
gramming language, such as BASIC, PASCAL or C 

15 for a computer such as the IBM Personal System / 2 
(PS/2) family of computers which supports these lan- 
guages. 

Referring to Fig. 3, the registration of objects will 
be described. The method starts, step 51, when in- 

20 voked by the user. In step 53, the user selects which 
object or objects that the user wishes to register. In 
step 55, the user enters the restriction attribute for 
each selected object. The restriction attribute deter- 
mines if the object is to be displayed by the invention. 

25 This attribute is stored in a Restriction Table. The Re- 
striction Table is a storage area that contains attri- 
butes of the availability of objects to be displayed. In 
step 57, either the user or the method itself specif ies 
the object type. The object type is used to determine 

30 if the object is displayable. Adisplayable object is one 
that can be transformed into a displayable format, for 
example a binary bit image. In step 59, either the user 
or the method specifies display characteristics for the 
object. The display characteristics include which vid- 

35 eo adapter or adapters the object should be sent to 
(which information is stored in the Video Adapter 
Router Table), whether the object will be segmented 
into plural frames, whether the displayed frames be 
flipped manually or automatically and if automat teal- 

40 ly, the timing interval for displaying each frame. In 
step 61, either the user or the method specifies the 
transform capability of the object. The transform ca- 
pability is an attribute that provides information on 
transforming the object into pages or into a single im- 

45 age. Also, the transform needed to display the object 
is registered as an attribute. In step 63, the method 
stops. 

After the objects have been registered using the 
method of Fig. 3, presentation of the objects can pro- 

50 ceed. As described above, presentation of an object 
occurs when the object is associated with the presen- 
tation device, such as by dropping the object icon 
onto the presentation device icon. This user action ini- 
tiates the method of Figs. 4a-4c. 

55 In Fig. 4a, the method starts, step 65. In step 67, 

the Restriction Table is accessed. The method deter- 
mines if the object is restricted for display, step 69. 
This is done by referring to the Restriction Table. For 
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example, if Chart A is dropped onto the projector icon 
17A, then the listing for Chart A in the Restriction Ta- 
ble is examined to determine if Chart A is restricted. 
If the result of step 69 is YES, the object is restricted 
for display, then the restricted condition is reported to 
the user on the computer screen 13, step 71, and the 
method stops, step 73 (see Fig. 4c). Alternatively, the 
error condition could be reported by an audio signal. 

If, however, the result of step 69 (see Fig. 4a) is 
NO, the object is not restricted for display, then the 
Video Adapter Router Table is accessed, step 75. In 
step 77, the method determines if the object can be 
routed to an adapter. This is done by determining from 
the Video Adapter Router Table if the object has been 
registered to one or more particular adapters. If the 
result of step 77 is NO, then the condition is reported 
to the operator on the computer screen 13, step 79 
(see Fig. 4b). The method stops, step 73 (see Fig. 4c). 

If the result of step 77 (see Fig. 4a) is YES, the 
object can be routed to an adapter, then the method 
proceeds to step 81 (see Fig. 4b) f where a request to 
project the object is input. Step 81 is used as a con- 
firmation to project the object. The confirmation can 
be input by the user. Alternatively, the confirmation 
can be provided by default. 

Next, in step 83, the method determines if the ob- 
ject is of a displayable type. This is determined from 
the object type attributes associated with the object. 

If the result of step 83 is NO, then the method de- 
termines if a transform exists for the object, step 85. 
A transform converts the object into a presentable for- 
mat suitable for the presentation device. If the result 
of step 85 is NO, then the object cannot be displayed 
and the condition is reported, step 79. However, if the 
result of step 85 is YES, a transform does exist for the 
object, then in step 87 the object is transformed into 
a presentable format. In step 89, the transformed im- 
age is scaled to the size of the frame which is to be 
displayed. Then, in step 91 , the transformed object or 
image is projected to the media or presentation de- 
vice. For example, if Chart A 27A of Fig. 2 was the ob- 
ject dropped onto the projector icon 17A, then the 
Chart 27 would be displayed on the projector screen 
21 as shown in Fig. 1 . After step 91 , the method stops, 
step 73 (see Fig. 4c). Dropping another object onto 
the projector icon 1 7A restarts the method of Figs. 4a- 
4c. 

If the result of step 83 is YES, the object is of a 
displayable type, then the method determines if the 
object is to be converted from page to image to 
frames, step 93. This step determines if the object is 
to be segmented into portions, with each portion be- 
ing displayed one at a time. For example, on a multi- 
page word processing document, it may be desirable 
to display only one page at a time. If so, then each 
page is transformed into a binary image, which is pre- 
sented as a single frame on the screen. Displaying all 
of the pages at once could make the document un- 



readable due to the small size of the characters. 
Whether to convert the pages to frames is determined 
from the object attributes. To allow the object to be 
paginated during display, so that smaller portions of 
5 the object can be displayed, the object is registered 
as having a displayable type, to produce a YES from 
step 83. 

If the result of step 93 is NO, that is the entire ob- 
ject is to be displayed as a single frame, then the 

10 method proceeds to step 87 and the following steps, 
which have already been discussed. 

If the result of step 93 is YES, then the object is 
to be segmented. First, the object is scanned to iden- 
tify codes for the beginning and ends of pages, step 

15 95. This step allows the method to identify the pages 
within the object. After scanning the object, the meth- 
od, in step 97 (see Fig. 4a), determines if the object 
is empty. If YES, then the method proceeds to step 
71 to report the condition. 

20 If the result of step 97 is NO, then the first page 

is transformed to a binary image into a frame, step 
99. Step 101 determines if the transformed page is at 
the end of the object. If NO, then the method gets the 
next page, step 103 and transforms it, step 99. If the 

25 result of step 101 is YES, wherein all of the pages of 
the object have been transformed, then the method 
proceeds to step 105. 

In step 105, the method determines if the frames 
are to be displayed in a manually timed sequence. 

30 This is determined from the object attributes. If NO, 
then the frames will be displayed in an automatic 
timed sequence. In step 107, the timer profile is ac- 
cessed. The time profile is an attribute of the object 
that was provided in the registration service of Fig. 3. 

35 In step 109, the frames are projected by the presen- 
tation device 17 according to the timer profile. The 
timer profile determines the timing sequence of dis- 
playing the frames. For example, each frame could 
be displayed for five seconds. After five seconds, the 

40 next frame is shown on the screen 21 . After all of the 
frames have been displayed, the method stops, step 
73. 

If the frames are to be displayed with a manual 
timing sequence, then the result of step 105 is YES. 

45 The method then proceeds to step 111 (see Fig. 4c) 
to await a request from the user to change the display. 
Such a request could come from the keyboard 15 or 
other input device. The user can flip forward to the 
next frame, flip backward to the previous frame, 

so zoom in (or out) on a portion of a frame, or exit to re- 
move the object from the display. 

Instep 113, the method determines if the user re- 
quest is to flip forward. If YES, then the method de- 
termines if there is another frame to flip to by deter- 

55 mining if the end of the object has been reached, step 
1 1 5. If NO, then the next frame is projected to the pre- 
sentation device, step 117. The display condition is 
reported to user, step 119 and the method returns to 
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step 111. If the result of step 115 is YES, the end of 
the object has been reached, then this condition is re- 
ported, step 119. 

If the user request is not to flip forward, a NO is 
produced by step 113 and the method determines if 5 
the user request is for an auxiliary focus, such as 
zoom, step 121 . If YES, then the auxiliary function is 
activated, step 123 and the method returns to step 
111. 

If the user request is not for auxiliary focus, a NO 10 
is produced by step 121 . In step 125, the method de- 
termines if the user request is to exit the presentation 
service. If YES, then the method stops, step 73 and 
the object is no longer displayed. 

If the request of step 125 is NO, then the user re- is 
quest is determined to be, by default, flip backward. 
In step 127, the method determines if the frame being 
displayed is at the beginning of the object. If YES, 
then a flip backward is not obtainable and the condi- 
tion is reported, step 119. If NO, then the previous 20 
frame is projected to the presentation device 17, step 
129. The display condition is reported, step 119. 
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1. A method of presenting an object in a data proc- 
essing system, said presentation being with a 
presentation device, comprising the steps of: 

a) providing said object with attributes that are 30 
relevant to the presentation of said object; 

b) determining when said object is to be pre- 
sented; and 

c) transforming said object into a displayabie 
format in accordance with said attributes and 35 
providing said transformed object to said pre- 
sentation device. 

2. The method of d aim 1 wherein said step of deter- 
mining when said object is to be presented fur- 40 
ther comprises the steps of: 

a) displaying a representation of said object 
and a representation of said presentation de- 
vice on a user interface of said data process- 
ing system; and 45 

b) determining if said object representation is 
associated with said presentation device rep- 
resentation. 

3. The method of claim 1 wherein said step of pro- 50 
viding said object with attributes that are relevant 

to the presentation of said object further compris- 
es the step of providing said object with a restric- 
tion attribute, said restriction attribute determin- 
ing whether said object is to be presented. 55 

4. The method of claim 1 wherein said step of pro- 
viding said object with attributes that are relevant 



to the presentation of said object further compris- 
es the step of providing said object with a router 
attribute, said router attribute determining which 
presentation device or devices are to present 
said object. 

5. The method of claim 1 wherein said step of pro- 
viding said object with attributes that are relevant 
to the presentation of said object further compris- 
es the step of providing said object with an object 
type attribute, said object type attribute deter- 
mining whether said object is displayabie by said 
presentation device. 

6. The method of claim 1 wherein said step of pro- 
viding said object with attributes that are relevant 
to the presentation of said object further compris- 
es the step of providing said object with a seg- 
mentation attribute, said segmentation attribute 
determining whether said object is to be segment- 
ed into plural segments for presentation. 

7. The method of claim 6 wherein said step of pro- 
viding said object with attributes that are relevant 
to the presentation of said object further compris- 
es the step of providing said objectwith a sequen- 
tial control attribute, said sequential control attri- 
bute determining if said object segments are to 
be presented in an automatically timed sequence 
or in a manually controlled sequence. 

8. The method of claim 6 further comprising the 
step of displaying said segments by allowing a 
user to either present an unpresented segment or 
present a previously presented segment. 

9. An apparatus for presenting an object in a data 
processing system, said presentation being with 
a presentation device, comprising: 

a) means for providing said object with attri- 
butes that are relevant to the presentation of 
said object; 

b) means for determining when said object is 
to be presented; and 

c) means for transforming said object into a 
displayabie format in accordance with said at- 
tributes and means for providing said trans- 
formed object to said presentation device. 

1 0. The apparatus of claim 9 wherein said means for 
determining when said object is to be presented 
further comprises: 

a) means for displaying a representation of 
said object and a representation of said pre- 
sentation device on a user interface of said 
data processing system; and 

b) means for determining if said object repre- 
sentation is associated with said presentation 
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device representation. 

11. The apparatus of claim 9 wherein said means for 
providing said object with attributes that are rel- 
evant to the presentation of said object further 5 
comprises means for providing said object with a 
restriction attribute, said restriction attribute de- 
termining whether said object is to be presented. 

12. The apparatus of claim 9 wherein said means for 10 
providing said object with attributes that are rel- 
evant to the presentation of said object further 
comprises means for providing said object with a 
router attribute, said router attribute determining 
which presentation device or devices are to pres- 1 5 
ent said object 

13. The apparatus of claim 9 wherein said means for 
providing said object with attributes that are rel- 
evant to the presentation of said object further 20 
comprises means for providing said object with 

an object type attribute, said object type attribute 
determining whether said object is displayable by 
said presentation device. 

25 

14. The apparatus of claim 9 wherein said means for 
providing said object with attributes that are rel- 
evant to the presentation of said object further 
comprises means for providing said object with a 
segmentation attribute, said segmentation attri- 30 
bute determining whether said object is to be seg- 
mented into plural segments for presentation. 

15. The apparatus of claim 14 wherein said means 

for providing said object with attributes that are 35 
relevant to the presentation of said object further 
comprises means for providing said object with a 
sequential control attribute, said sequential con- 
trol attribute determining if said object segments 
are to be presented in an automatically timed se- 40 
quence or in a manually controlled sequence. 

16. The apparatus of claim 14 further comprising 
means for displaying said segments by allowing 

a user to either present an unpresented segment 45 
or present a previously presented segment. 



50 



55 



6 



RN-qnooir* <fp 083i?abap i > 



EP 0 631 246 A2 




Fig. I 



7 



BNSDOCID: <EP 0631246A2J_> 



EP 0 631 246 A2 




Fig. 2 



EP 0 631 246 A2 



( START *y ^51 
User 

selects an object(s) 



-53 



User enter ^55 
restriction attribute for object(s) ' ' 



I 



User or service specifies 
object type 



^57 



User or service specifies 
display characteristics for object 



User or service specif ies 
transform capability 



/-\^59 



Q STOP "y^63 



Fig. 3 



BMSOOCIO: <EP 063124SA2 I 



EP 0 631 246 A2 




BWOfW»l>V -CO 



BP 0 631 246 A2 



Move to 
next frame 




3 



Activate auxiliary 
function 
(zoom) 



Move to 
previous 
frame 



YES 



Fig. 4c 

11 



BNSOOCID: <EP _ .0631246A2 I > 



EP 0 631 246 A2 



4 



81 



Request to 
project object 




95 vy\ 



Scan 
object 



NO 



NO 




Transform 
object to 
presentable 
format 



89 nj~s 



I 



Scale 

to 
frame 
size 



91 



I 




NO 



87 



79 




Project object to 
media device 




Report Condition 



F 



Fig. 4b 



12 



BMSOOCIO <EP 



0831248A2 I > 



3 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 




(Tj) Publication number: 0 631 246 A3 



EUROPEAN PATENT APPLICATION 



@ Application number : 94480045.7 
@ Date of filing : 25.05.94 



© int. ci. 5 : G06F 15/403, G06F 3/033 



(So) Priority : 25.06.93 US 83242 

(43) Date of publication of application : 

28.12.94 Bulletin 94/52 

@) Designated Contracting States : 
DE FR GB 

(§§) Date of deferred publication of search report : 

12.04.95 Bulletin 95/15 

(71) Applicant : International Business Machines 
Corporation 
Old Orchard Road 
Armonk, N.Y. 10504 (US) 



(72) Inventor : Fitzpatrick, G. P. 
1527 Sweetgum Circle 
Keller, TX 76248 (US) 
Inventor : Salahshour, A. 
807 Mesquite Lane 
Keller, TX 76248 (US) 
Inventor : Williams, Marvin L. 
1152 Settlers Way 
Lewisville, TX 75067 (US) 

@) Representative : Lattard, Nicole 
Compagnie IBM France 
Departement de Propriety Intel lectuelle 
F-06610 La Gaude (FR) 



3 

CO 

CO 
CO 



DESKTOP 



= CD 



@ Method and apparatus for controlling presentations of objects on a user interface of a data 
processing system. 

(57) Objects on a data processing system are 

provided to a multimedia presentation device s — 25 
for presentation purposes. Each object is pro- 
vided with one or more attributes. These attri- 
butes are registered before the presentation. 
When an object is selected for presentation, the 
object is transformed into a presentable format 
in accordance with its attributes. Such attri- 
butes include whether the object is restricted 
for display, the particular presentation device or 
devices that will present the object, the types of 
transforms to be performed on the object to 
ready the object for presentation, whether the 
object should be segmented into plural seg- 
ments and if so, then the manner in which the 
segments are presented. After the transfor- 
mation, the object is provided to the approp- 
riate presentation device. 
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